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In this note we consider the following problem to study the effect of malicious players 
on the social optimum in load balancing games: Consider two players SOC and MAL 
controlling (1 — a) and a fraction of the flow in a load balancing game. SOC tries to 
minimize the total cost faced by her players while MAL tries to maximize the same. 

If the latencies are linear, we show that this 2-player zero-sum game has a pure strategy 
Nash equilibrium. Moreover, we show that one of the optimal strategies for MAL is to 
play selfishly: let the a fraction of the flow be sent as when the flow was controlled by 
infinitesimal players playing selfishly and reaching a Nash equilibrium. This shows that 
O a malicious player cannot cause more harm in this game than a set of selfish agents. 

We also introduce the notion of Cost of Malice - the ratio of the cost faced by SOC at 
fN| equilibrium to (1 — a) OPT, where OPT is the social optimum minimizing the cost of all 

the players. In linear load balancing games we bound the cost of malice by (1 + a/2). 

m 
in 

^ 1 Introduction 

Games played by a large number of people in a decentralized manner seem to be susceptible 
Q\ to malicious players and it becomes important to understand the performance degradation 

due to the presence of malice. A particular class of games which have come under focus are 
J> congestion games. An example where malicious activity can degrade the performance of a 

congestion network, is a Denial of Service attack on a web-server. In the past few years there 
have been studies [[BKP07 . [MSW06] . |KV07] ] investigating the effect of malicious players on 
the other rational but non-cooperative players of the game. 

We study the effect of malicious players in non-atomic congestion games from a centralized 
viewpoint. In particular, we investigate how adversely the presence of malicious entities can 
affect the social optimum of a congestion game. It is probably not very surprising that in 
general congestion games malicious players can affect the social optimum badly (and we make 
it precise how adversely later). In the special case of linear load balancing games, however, 
we make the following observations. 

In a load-balancing game, we have m parallel links joining a single pair of a source and a 
sink. One unit of flow is to be distributed on the links. Each link i has a latency li : [0, 1] — ► R+ 
which is assumed to be non- decreasing. If z is the amount of flow through a link i, then the 
cost of sending an infinitesimal portion Az of the flow on that link is l%(z) ■ Az. We consider 
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two players: MAL and SOC controlling a and (1 — a) fraction of the flow. The SOC player 
wishes to minimize the cost faced by his fraction of the flow, while the MAL player wishes to 
maximize this cost. We call this zero-sum game G a . 

Formally, a pure strategy of the SOC (and similarly, of the MAL) player is an allocation 
of flow on the m links given by the vector y = {yi, • • • , y m ) (and similarly x = (x\, • • • , x m )) 
with J2T=i Vk = (1 ~~ a ) (and similarly J2T=i x k = 01). The cost faced by the SOC player on 
playing the strategy y while the MAL player plays x is 

m 

C( x > y) = ^2 Vkh(xk + yk) 
k=i 

The SOC player wishes to minimize this cost while the MAL player wishes to maximize 
it. This defines the game G a . 

Remark: A mixed strategy P is a probability distribution over pure strategies, i.e. a 
player plays a mixed strategy P is she plays a pure strategy z with probability P(z). Since 
we have a continuum of pure strategies in G a , one may think that an equilibrium in mixed 
strategies would imply an equilibrium in pure strategies by simply replacing a mixed strategy 
P by a pure strategy z = J2 Z -P( z ) z - Following example shows that this implication does not 
hold, at least by above trivial transformation. If SOC plays a mixed strategy P and MAL 
plays x, then 

m m 

Expected cost to SOC = ^ P(y) ^ ykk(yk + x k ) = ^ ^{P{y)ykh{yk + x k )) 

y k=l k=l y 



Instead, if SOC plays y = ^2 y P(y)y in response to MAL's pure strategy x, we get 

m 

C(*,y) = ^2ykh{yk + x k ) 
k=i 

= E ( E p (y)y* ) **((E p{ *^ + Xk ^ 

k=l \ y / y 

= E ( E p ^ ) E( p (y)^(^ + **)) 

k=l V y / y 

Notice that the costs are different in the two cases. Therefore, our results for pure strategies 
are non-trivially stronger than their possible counterparts for mixed strategies - which them- 
selves do not follow from classical theorems since the strategy space is a continuum. 

Our main result is that there exists a pure strategy Nash equilibrium in a linear load- 
balancing game G a . Since the game is zero-sum, equivalently we have the following minimax 
theorem: 

max min C(x, y) = min max C(x, y) 

x y y x 

where x, y are pure strategies of MAL and SOC respectively and C(x, y) is the cost to SOC. 
This shows that the order of play does not matter and it makes sense to talk about optimal 
strategies for the players. 
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We feel this is bit surprising for many reasons. Firstly, since both players have an infinite 
number of strategies, it is not even clear why there should be an equilibrium even in mixed 
strategies. Moreover, although our setting is that of a congestion game which have pure 
equilibria, the game G a is not a congestion game itself. Finally, the linear latencies are 
required: there is an example of a two link game with simple convex latencies which has no 
pure strategy Nash equilibrium. 

Another observation we make about G a is that one of the optimal strategies for MAL 
is to route its a-fraction of the flow selfishly, that is, what the equilibrium outcome would 
have been if this a fraction were controlled by infinitesimal non-atomic agents each trying to 
minimze its latency. In other words, a malicious player can inflict no more harm than a set of 
selfish agents. Possibly, the malicious player could use a self-destructive strategy to degrade 
the performance, but it somehow does not need to do so in linear congestion games. 

Our next result bounds the Cost of Malice (CoM), a quantity which we use to measure 
the effect of malicious players on the system. Formally, CoM is defined as the ratio of the 
cost faced by the SOC player in an equilibrium of G a to (1 — a)OPT, where OPT is the 
socially optimum cost in the absence of malice, when the whole 1 unit was controlled by 
the SOC player. Thus CoM in a way measures the effect of the malicious players on the 
social optimum. As probably expected, in general congestion games CoM can be unbounded. 
However, for linear load balancing games we show it to be bounded by (1 + a/2). 

1.1 Related Work 

In the computer science community, there have been a number of studies investigating the 
effect of malicious agents in congestion games. The first work closest to our setting was by 
Karakostas and Viglas [ KV07] who study how the presence of malicious agents in a congestion 
game effects the price of anarchy. That is, how the ratio between the cost of agents in a Nash 
equilibrium and the social optimum, which the authors call the coordination ratio, change 
with the amount of malice in the system. More recently, Babaioff et al [BKP07 consider the 
malicious agent in the game along with the infinitesimal players and show that for general 
latency functions, the game need not have a pure Nash equilibrium, and they show the 
existence of a mixed Nash equilibrium. Moreover, they define the Price of Malice as the 
rate of deterioration in the total performance of the remaining selfish players per unit flow of 
malice and show that there exist networks where the price of malice may indeed be negative, 
while on the other hand there are networks where the price could be quite large. 

As we note in the introduction, the focus of the works above were on the effect of malice on 
the equilibrium of the system: how the equilibrium degrades and how the game between the 
selfish agents and the malicious agent takes place. On the other hand we are more interested 
in how the presence of malice affects the social optimum itself. Thus our work complements 
the works of Karakostas and Viglas |KV07] and Babaioff et al [BKP07 . 

The study of malice has not been restricted to the congestion game setting. Moscibroda 
et al [MSW06J study the effect of malicious agents in a virus inoculation game. Indeed, they 
also define a notion of price of malice as the ratio of the cost of an equilibrium setting with 
and without malicious agents. The definition is not quite same as that of Babaioff et al 
|BKP07| . In fact, to avoid a third "price of malice" definition, we call the effect of malice to 
the optimum, the "cost of malice" instead. 

Our work is in some sense similar to the work on Stackelberg strategies started by Flough- 
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garden [RouOl and later works by Karakostas and Kolliopoulos [KK07j . Swamy |Swa07j and 
Sharma and Williamson |SW07] . In Stackelberg games there exists a leader who controls 
some amount of flow which he plays first to which the remaining selfish players respond. It 
is instructive to compare this leader with our SOC player. In fact, our proof of bounding the 
cost of malice goes via the strategy SCALE in the paper of Roughgarden |Rou01] . 

1.2 Notational Preliminaries 

We establish a few notations before going on. We use the function 6r() to denote best- 
response. Given MAL and SOC's plays x and y, we write x = br(y) if x is the best response 
to y. We denote SOC-MAL := min y max x C(x, y) as the minimum cost faced by the SOC 
player when he plays first. We define MAL-SOC similarly. We will show the existence of a 
pure Nash equilibrium by showing SOC-MAL = MAL-SOC. 

We now review the properties of optimum and Nash flows in load balancing games. If 
an amount of flow j3 < 1 is to be routed on the m-links and moreover this flow is controlled 
by infinitesimal non-atomic agents, then the resulting (unique) equilibrium flow, x has the 
following property: 

Xi > => k(xi) < lj(xj) 

We call this flow, F^((3). If a single player controlling the whole (3 units of flow plays Fn(/3), 
we say he is playing NASH. 

If the (3 amount of flow is controlled by a single player wishing to minimize the total cost, 
then the optimum flow x satisfies the following property: 

Xi > => k(Xi) + Xil'^Xi) < lj(Xj) + Xjlj(Xj) (1) 

We denote the total cost faced by the player as Cs(fl). Note that the cost of malice is defined 

n n/r C{x,y) 
as CoM := sup — 

(x.,y):Nash(G a ){ L _ "J^SUJ 

2 Existence of Pure Nash equilibrium in Linear Congestion 
Games 

Suppose the latency of the link i is given by k(x) = a. L x+bi. The following lemma characterizes 
the best response of the MAL player to a SOC player's play. 

Lemma 2.1 Suppose the SOC player plays y. Then x is MAL's best reponse to y if and 
only if 

Xi >0 aiyi > ajyj Mj (2) 

Proof: ( Only if part) For x\ > 0, we will prove that if ajyj > aiyi for some j, then MAL can 
strictly increase the cost to SOC by moving his jobs from link i to link j. Let x' be such that 
x' k = Xk-, for k 7^ i, j, with x' i = Q and x'- = Xj + x%. We have, 

C(x',y) - C(x,y) = ^ a k y k (x' k - x k ) 

k 

= ajyjXi - aiyiXi > 
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(If part) Let L = m&xa k y k . For any x satisfying property 2 we have X{ > => aj?/i = L. 

k 

Therefore, C(x,y) = YjkVk{ a k{Vk + x k ) + b k ) = Yj k Vkhvyk) + La 

That is, the cost to SOC when MAL responds with any x satisfying property [2] is the 
same, and has to be optimal from the only- if part. □ 

Theorem 2.2 In any linear load balancing game, there exists pure strategies x, y of MAL 
and SOC such that x = br{y) and y = br{x). Equivalently, there exists a pure strategy Nash 
equilib rium in every load balancing game G a . 

Proof: Let x = F n (a), that is MAL's strategy is the NASH strategy. Then by definition of 



NASH (see Section 1.2), we know that: Xi > a{Xi + 6j < ajXj + bj, Vj 

Let us now characterize SOC's best response: y = fer(x). Note that y is the strategy OPT 
with the induced latencies h(yi) = k(xi + yi). Therefore, 

y j > o k(yi) + yJiivi) < ij(yj) + yjlj(yj) Vj 

laiyi + aiXi + h < 2ajyj + ajxj + bj Vj 

We now claim that x is in fact a best response to any such y. To show this, from 



Lemma(2.1 ) it is enough to show 

Xi > cnyi > ajyj Vj 

Consider i such that x% > and any other j. If yj = then the above inequality is trivially 
true. Otherwise from the optimality property of y, we have 2ajyj+ajXj+bj < 2a. L yi+aiXi + bi. 
But since x% > 0, we have aiXi + b% < ajXj + bj. Therefore, aiyi > ajyj. □ 

Notice that one of the equilibrium pure strategies of the malicious player is NASH. Recall 
that NASH is equivalent to the equilibrium reached by a set of selfish agents, each controlling 
only an infinitesimal fraction of the flow. Hence, by the above min-max theorem, we conclude 
that MAL can do no more harm than a set of selfish agents. 



3 Bounding the Cost of Malice 

In this section, we bound the cost of malice for linear load balancing games. Let s = -F/v(l) 
be the NASH flow of value 1 in a load-balancing game. By definition latencies are equalized 
by s on every link. Let L be this common latency. Then the total cost of this flow, 

Cn{1) = ^2s k l k (s k ) = L 

k 

Lemma 3.1 In linear load balancing games, MAL-SOC < (1 — a)Cjv(l) 

Proof: Suppose the player MAL plays x. We demonstrate a strategy for the SOC player 
which gives him cost at most (1 — a)Cjv(l). Define S = {i\xi > s^}. Let y be as follows 

_ f if i € S 
^ l \ Qi otherwise 
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where 0, is such that 9i + Xi < Sj. Since ^J(sj — Xj) > (1 — a), such a y exists. Moreover, 

k<^S 

since 9i + Xi < s» on each link used by SOC, the latency faced by SOC on any link is at most 
L = Cjv(1). Therefore, MAL-SOC < C(x,y) < (1 - a)C N (l) □ 

Thus we get that no matter what MAL plays, SOC can always make sure that her cost is 
at most (1 — a)CV(l). Therefore, using the theorem of Roughgarden and Tardos |RT02 
which bounds CV(1) and Cs(l), in non-atomic linear load balancing games, we arrive at the 
following bound on the cost of malice. 

Theorem 3.2 In linear congestion games, SOC-MAL = MAL-SOC < f (1 - a)C s (l). Thus 
CoM< §. 

Note that in the above theorem, the cost of malice does not depend on the amount of malice. 
In particular, even when there is no malice, we only get a bound of 4/3. In what follows, we 
show that CoM < (1 + a/2). This is a tighter bound when a £ [0, 2/3]. 

Consider the following simple strategy for SOC player called SCALE. This strategy was 
suggested by Roughgarden [RouOl in his study of Stackelberg scheduling strategies (although 
SCALE was not a good strategy for his purposes). We are able to bound SOC's cost which 
in turn gives an upper bound on SOC-MAL. 

SOC is said to follow SCALE if she simply plays y = (1 — a)y* , where y* = Fg(l), the 
socially optimum flow. That is, she scales the strategy OPT down to a (1 — a)-flow. Abusing 
notation, we also denote by SCALE the value of C(x,y) when SOC follows SCALE. 

Theorem 3.3 In linear load-balancing games, 

SCALE < (i + |)(i- a )Cs(l) 

and therefore CoM < (1 + a/2). 



Proof: By Lemma 2.1 we know that the best response of MAL is to pass all his flow through 
the link that maximizes a k x k . Without loss of generality, suppose MAL uses link 1 to send 
all his flow. Then 



SCALE = y k ia k y k + b k ) + aiy\a 



k=l 



Replacing y k by (1 — a)y* k and using the fact that y* k has cost Cs(l), we get 

m 

SCALE = (1 - a) 2 C s (l) + a(l - a)(oiyJ + ^ b k y* k ). 

k=l 

Now we prove aiy* + Y1T=1 ^y k < |Cs(l) which would complete the proof. As y* = ^(1), 
y* obeys property [TJ For linear latencies, it translates into: 

y* >0 => 2a iy * + bi = 2a x y\ + b x 

Multiplying above equation by y*, we get 

Vi > => a i y i H y i = ayy^ 
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Summing above equations over all y* > and invoking Y^k=l Vk = we 

' (h-h) 

k=l k=l 



my* = £ a ^ 2 + £ 



~Vk 



Adding Ylk"=i ^kUl to both sides in above equation, we get 



m m (h — h \ i 

fc=i fc=l 

where the last inequality follows from the fact that YlT=i(bk — bi)yl < J2T=i bkUk — 
□ 



Remark: We should state that the analysis of the SCALE strategy in Theorem 3.3 is tight. 
Consider the following two links with latencies (l,Mx). The social optimum is to send the 
flows in the ratio ( 2 ^ 1 , ^) and the optimum cost is 4A ^~ 1 . The SCALE strategy would 

send flow as ( ^ 2M ~2j^ l ~°^ , J and then MAL would send the a fraction on the second 

link, leading to a cost ( 1 ~ a )(( 4 4 +^ a ) M ~ 1 ) _ Thus CoM = ^ 4 " l 4 2 ^_ fl ^~ 1 which goes to (1 + a/2) as 
M goes to infinity. On the other hand if SOC sends all its (1 — a) flow on the first link, the 
cost of malice is which goes to 1 as M grows. 

4 Malice in General Congestion Games 

The zero-sum game between a malicious player MAL and a socially optimum player SOC 
is also well defined for general congestion games as well. However, as we saw, the property 
of having an equilibrium in pure-strategies breaks down when we go to non-linear latencies 
even in the load-balancing case. A question which arises is if the existence in pure strategies 
generalizes to general linear congestion games. In particular, does this property hold in 
network congestion games. We believe the answer to be negative although we do not have 
an example. Nevertheless, we do know of examples where MAL's optimal strategy ceases to 
play selfishly. Rather, in most examples we consider, the optimal strategy of MAL is to route 
a flow which maximizes the minimum latency path. 

Moreover, in network congestion games, the cost of malice can be large. A simple example 
is a parallel link s-t network (which is the same as the load balancing game) with one extra 
path from s to t which uses all the links. It is not hard to see that the best strategy of the 
MAL player is to route all its flow on the extra path and then the cost-of-malice becomes 
proportional to the number of parallel links. 
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